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Abstract 

The error-pattern correcting code (EPCC) is incorporated in the design of a turbo equaUzer (TE) 
with aim to correct dominant error events of the inter-symbol interference (ISI) channel at the output 
of its matching Viterbi detector By targeting the low Hamming-weight interleaved errors of the outer 
convolutional code, which are responsible for low Euclidean-weight errors in the Viterbi trellis, the 
turbo equalizer with an error-pattern correcting code (TE-EPCC) exhibits a much lower bit-error rate 
(BER) floor compared to the conventional non-precoded TE, especially for high rate apphcations. A 
maximum-likelihood upper bound is developed on the BER floor of the TE-EPCC for a generalized 
two-tap ISI channel, in order to study TE-EPCC's signal-to-noise ratio (SNR) gain for various channel 
conditions and design parameters. In addition, the SNR gain of the TE-EPCC relative to an existing 
precoded TE is compared to demonstrate the present TE's superiority for short interleaver lengths and 
high coding rates. 
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Inter-symbol interference, turbo equalization, dominant error events, error pattern correcting code, 
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I. Introduction 

The turbo code of [1], [2] has been utiUzed as a practical means to approach the inter- 
symbol-interference (ISI) channel capacity in what has been termed turbo equalization [3], [4], 
in which two recursive systematic convolutional codes (RSCCs) concatenated in parallel are 
concatenated serially to the ISI channel. Since then, the turbo equalization terminology has 
grown to encompass any soft-decodable code that is iteratively decoded by exchanging soft 
information with a channel matched detector. The family of turbo equalizers now includes low- 
density-parity check (LDPC) codes and turbo product codes (TPC). A standard turbo code is a 
parallel concatenation of convolutional codes (PCCCs) connected by an interleaver, for which the 
probability of generating low Euclidean weight error events is considerably reduced by the action 
of the uniform interleaver. This in effect improves the overall system bit-error-rate (BER) in the 
low-to-medium signal-to-noise ratio (SNR) region. A PCCC is decoded by an iterative exchange 
of soft information between maximum a posteriori probability (MAP) decoders matched to the 
constituent RSCC decoders [5]. A turbo equalizer (TE) based on an iterative receiver composed of 
a PCCC soft decoder and a channel detector was discussed in [6]. A simpler serial concatenation 
of a single RSCC and a precoder through an interleaver was found to perform just as well in [7] 
for wireless communication applications, and in [8] and [9] for magnetic recording applications. 
Precoding makes the ISI channel appear recursive to the outer interleaved RSCC, where the 
non-precoded ISI channel can viewed as an inner nonrecursive rate-1 convolutional code [4]. 
In this manner, precoding is essential to achieve better turbo gain in the low SNR region, i.e. 
"waterfall region". This was first shown in the context of serially concatenated convolutional 
codes (SCCCs) in additive white Gaussian noise (AWGN) in [10], where it was demonstrated 
that the inner constituent convolutional code has to be recursive to achieve a turbo gain. Briefly 
afterwards, this was demonstrated for a SCCC-TE running on the dicode channel in [11]. The 
concatenation of precoding and RSCC through an interleaver works by enhancing the error 
weight "spectral thinning" effect, by which the frequency of low Euclidean distance errors is 
uniformly reduced. 

We propose an alternate error-weight spectral shaping approach that aggressively targets the 
low end of the error Euclidean distance distribution, enhancing BER performance in the "error 
floor" region, while maintaining the waterfall region gain of conventional TE. The proposed 
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method is based on directly targeting the dominant error patterns of the channel, which are also 
the lowest Euclidean distance errors, via a matching error correction code, termed the error- 
pattern correction code (EPCC). The EPCC was first proposed to handle single dominant error 
event occurrence in [12] [13], and later enhanced in [14] and [15] to handle multiple error 
event occurrences. A practical EPCC-based turbo equalizer tailored to the magnetic recording 
application was first proposed in [16]. In our TE setup, the EPCC is matched to the non-precoded 
ISI channel and serves as an inner code for an outer interleaved RSCC. Since the EPCC maintains 
a substantial error correction power while having a high code rate that is close to 1, the hope 
is that the redistribution of redundancy between EPCC and the outer RSCC would improve 
overall system performance. In TE-EPCC decoding, the EPCC MAP decoder works iteratively 
with the outer RSCC MAP decoder to correct low Euclidean distance errors at the output of the 
channel's detector. This is compared to using a rate-1 precoder in the encoder side that prevents 
these errors from occurring in high frequency but can not eliminate them entirely. 

In this work, we conduct an error-event weight analysis of EPCC enhanced TE to be able 
to predict an upper bound on the BER performance, and hence establish the advantage of 
incorporating EPCC in the error floor region. The derived upper bound on BER is for the 
maximum likelihood (ML) decoder of the concatenated system, which the practical decoder is 
assumed to approach at high SNRs. A few points are worth mentioning regarding the derivation 
of such a bound. First, the bound is based on the notion of a uniform interleaver, which essentially 
averages out the effect of good and bad instantaneous interleavers on the bound. The implication 
of this assumption on the analytic BER bound is that the particular choice of the practical 
interleaver is not a factor in our turbo system comparison herein. Second, the derivation of the 
bound presumes a maximum-likelihood decoder, which fails short of accurately describing the 
iterative turbo gain that is more pronounced at lower to medium SNR, where the analysis of 
turbo code performance at this lower SNR region remains largely an open problem. Incidentally, 
our proposed approach here based on probabilistic correction of low Euclidean distance errors 
is designed to work in the floor region where the bound is accurate. Finally, the bound assumes 
that coded data is i.i.d., which becomes a more realistic approximation as the code rate of the 
RSCC approaches unity. 

The paper is organized as follows; In Section n we review the main concepts of EPCC 
code construction and decoding based on its algebraic properties; we also present EPCC design 
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examples that we later use in the simulation of Section VI. In Section III we present the encoder 
and decoder components of the conventional precoded and non precoded TEs and of the TE- 
EPCC. Section IV analyzes the ML BER performance of the TE-EPCC and the conventional 
TE based on the overall error weight spectrum of the coded channel. Furthermore, this section 
discusses an efficient method to evaluate the BER bound based on multinomial theory, assuming 
a single EPCC codeword per interleave. In Section V we explain the gain of the TE-EPCC over 
the TE in terms of the improved interleaver gain exponents of lower Euclidean-weight errors. 
Section VI discusses a practical method to implement TE-EPCC decoding that approaches the 
ideal ML decoder analyzed in the preceding section. Finally, The numerical results in Section 
Vn corroborate our claims in a variety of channel conditions for a combination of decoder design 
parameters. 

II. Review of the Error-Pattern-Correcting Code 

The cyclic codes described in [13] are based on construction of a generator polynomial g(x) 
that gives rise to distinct syndrome sets for all targeted dominant error patterns. It has been 
shown that such a g{x) can be obtained from the irreducible factors making up the polynomial 
representations of the dominant error patterns. The code can be further improved by introducing 
another factor in g{x), namely, a primitive polynomial that is not already a factor of g{x) [14]. 
The results are an increased code rate, improved single-error-pattem correction accuracy (via 
reduced miss-correction probability), and capability to correct some important multiple-pattern 
events based on a increased number of distinct syndrome patterns. 

We start by constructing a cyclic code targeting the set of l^ax dominant error events 

{e^^\x),e^^\x),...,et-\x)} 

represented as polynomials on GF{2) that can occur at any starting position k in the codeword 
of length It- A syndrome of error e^^\x) at position k is defined as s^^\x) — e^j^\x) mod g(x) 
, with g{x) being the generator polynomial of the code and mod the polynomial modulus 
operation. A syndrome set Sj for error type e^'''> (x) contains elements corresponding to all cyclic 
shifts of polynomial e*^*^(a;); elements of S, are thus related by s[.*|^- = x^ s^i^''modg{x). 

For unambiguous decoding of e('^(a;) and e'^^x), V{i, j}, we must have Si fl Sj — 0. This 
design requirement constrains g{x) to have distinct greatest common divisors with all e^^\x). 
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However, even if this constraint is satisfied, an element in Sj can still map to more than one 
position, i.e., the period of the syndrome set- and period of g{x)- can be less than Imax- Moreover, 
this constraint is only sufficient but not necessary. Also, as shown in [13], there may exist a lower 
degree g(x) that can yield distinct syndrome sets for the targeted error polynomials, resulting 
in a higher rate EPCC. A search method to find this g{x) is already discussed in detail in [13] 
and [15]. 

We now describe the construction and properties of the EPCC that will be deployed throughout 
the paper in the design of different turbo systems based on EPCCs. We target the dominant error 
events of a generalized two tap ISI channel of the form 1 — aD, < a < 1, for which the 
dicode and PRl channels are special cases. When a is close to 1, the dominant errors are: +, 

H — , H h, etc., which have the polynomial representations: e^^\x) = 1, e^'^\x) = 1 + x, 

e(3)(a;) = 1 + x + x'^, etc., i.e. polynomials on GF{2) for which all powers of x have nonzero 
coefficients. 

For the purpose of designing EPCC codes for use in the TE-EPCC, the component EPCC 
code rate should be very high. To maintain high rate, the EPCC codeword has to be extended 
to a few hundred bits, without proportionally increasing the number of parity bits required to 
achieve accurate single-error occurrence correction capability. Example EPCC codes are shown 
next, and the syndrome set periods of these codes are shown in Table HI 

• (630, 616) EPCC: Targeting error polynomials up to degree 9, we get the generator poly- 
nomial g{x) = 1 + x^ + x^ + x^ of period 30, via the search procedure in [13]. Choosing a 
codeword length of 30, 10 distinct, non-overlapping syndrome sets are utilized to distinguish 
the 10 target errors. However, the resulting (30,22) EPCC has rate 0.73 which incurs 
high rate penalty. By multiplying the base EPCC generator polynomial by the primitive 
polynomial 1 + x + x^, which is not a factor of any of the targeted errors, we obtain the 
extended generator polynomial ge{x) = I + x + x^ + x'^ + x^ + x^ + x^^ + x^^, which 
corresponds to the extended (630, 616) EPCC code of rate 0.98, and 14 parity bits. Then, 
as shown in [13], syndrome sets Si, S3, S7, and Sg have period 630 and thus can be decoded 
without ambiguity. On the other hand, syndrome sets S2, S4, Sq, and Sg have period 315, 
decoding to one of two positions. The worst would be S5 of period 126, and Sio of period 
63, which decode to 5 and 10 possible positions, respectively. Still, the algebraic decoder 
can quickly shrink the number of possible error positions to few positions by checking the 
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data support, and then would choose the one position with highest local reliability. 

• Shortened (126, 112) EPCC: Shorter lower-rate EPCC codes can be obtained by shortening 
the (630,616) EPCC. For example, a (126,112) EPCC of rate 0.89 can be derived this 
way with all syndromes sets, excluding syndrome set Sio, having period 126, and thus are 
decodable without ambiguity. 

• (210, 199) EPCC: To obtain short EPCC codes without jeopardizing the code rate through 
code shortening, we can target fewer error patterns in the code design. Targeting error 
polynomials up to degree 9, but excluding e^'^\x), we can extend the base generator 
polynomial g{x) = 1 + + + through its multiplication by the primitive polynomial 
1+x+x^, which we could not use before because its a factor of the polynomial representation 
of e'^'^\x). The resulting code is a (210, 199) EPCC of rate 0.95, 11 parity bits, and extended 
generator polynomial ge{x) = 1 + x + x^ + x^ + x'^ + x^^. 



TABLE I 

Syndrome set periods of various EPCC codes. 



Target error 


(630, 616) EPCC 


(126, 112) EPCC 


(210, 199) EPCC 


1 


630 


126 


210 


(l + x) 


315 


126 


105 


(l + x + x^) 


630 


126 


70 


(l + xf 


315 


126 


105 


(1 + x + x^ +x^ + a;**) 


126 


126 


42 


{l + x){l + x + xY 


315 


126 


35 


{l + x + x''){l + x^ + x'') 


630 


126 




{l + xf 


315 


126 


105 


(l + a; + a;2)(l + a;3 + a;6) 


630 


126 


70 


(1 + x){l + x + x^ + x^ + x'^f 


63 


63 


21 



m. A TE Incorporating the EPCC SISO Decoder 

The structure of the conventional SCCC-TE is shown in Fig. HJi). In the encoder side, a 
simple RSCC encodes the data stream, which is interleaved before being passed to the channel. 
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The concatenation of the convolutional code and ISI channel can be viewed in the context 
of turbo coding as a serial concatenation of an outer recursive code and an inner rate-1 non- 
recursive code through an interleaver. A polynomial-time iterative-type decoder can be designed 
based on the separation of the ML decoders of the inner and outer codes. The ML decoders 
iteratively exchange reliability information converging to the combined ML solution at high 
SNR. Separate ML detection and decoding can be realized via the Bahl-Cocke-Jelinek-Raviv 
(BCJR) algorithm [17], the soft output Viterbi algorithm (SOVA) [18], or the minimum mean 
squared error (MMSE) soft-in soft-out (SISO) detector [19], [20]. The BER gain in TE, however, 
is most notable at low SNRs, and declines rapidly as SNR increases resulting eventually in the 
error floor phenomenon. The gain at low SNR is further enhanced by including a rate-1 recursive 
component in the path of the coded interleaved bit stream. This is shown in Fig. \V[ii), where 
the trellis of SOVA is now matched to the recursive rate-1 coded channel ^[^^ ■ By the action 
of the ideal uniform interleaver, the fraction of errors in the Hamming-weight error distribution 
of the RSCC resulting in low Euclidean weight errors in the channel trellis is greatly reduced. 
This, as a result, improves the BER at low to medium SNR, where the contribution of the profile 
of error Euclidean weights to the BER far exceeds the single contribution of the minimum of 
these weights. 

A markedly different approach is proposed in the structure of Fig. [Hiii). The new method 
is based on replacing the rate-1 precoder with a high rate ECC that is designed to correct low 
Hamming weight errors that generate low Euclidean-weight trellis errors rather than constraining 
their incidence. Since the targeted errors possess low Hamming weights by design, this reduces 
the added complexity of encoding and decoding the EPCC, while the intrinsic channel property 
of these errors generating low Euclidean weight errors, particulary = 2, lowers the error floor 
at medium to high SNRs substantially. Nevertheless, since the practical decoder of the EPCC 
incurs some miscorrection, this new approach resembles a probabilistic "best effort" enhancement 
of c?|; that is achieved by correcting a sizable fraction of the originating Hamming weight 
errors. A soft-in soft-out (SISO) decoder of the EPCC is assumed in the iterative turbo loop. 
Since the EPCC is matched to the ISI channel, no interleaving should be present between the 
EPCC and the channel. On the other hand, an interleaver is essential between the EPCC and the 
outer RSCC. 

While the precoder and the 1 — aD channel can be jointly decoded with no added 
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complexity by matching the trellis to the combined coded channel its impractical to 

realize a similar joint ML decoder of the channel and the EPCC. Hence, in Fig. \V[m) separate 
SISO decoders of the channel and the EPCC are implemented. 

IV. Error-Rate Analysis of TE-EPCC 

In bounding the BER of the TE-EPCC, many of the basic steps and assumptions taken in 
[11] and [21] for bounding the BER of the conventional TE are utilized. To more closely reflect 
the practical recording channel, however, we apply our BER analysis to a generalized two-tap 
channel of the form 1 ± aD. The dicode (1 — D) and PRl (1 + D) channels are special cases 
corresponding to a = 1. In the proposed approach, we show how the BER is function of the error 
Euclidean distance distribution of the overall system. Then, we argue for TE-EPCC's enhanced 
performance by the virtue of its reduction of occurrence frequencies of low Euclidean distances 
in the overall distance distribution; it will also be shown that these low Euclidean distance 
components of the distribution dominate the system BER. Following the notations of [11], the 
maximum likelihood (ML) union bound on word error rate of a block code of codebook size 
M, of equally likely codewords and AWGN of zero mean and variance cr^ is 

1 /II II \ 

m=l rh^m 

where m and m are codewords separated by the Euclidean distance || — x^^ ||, and x^ 
is the noiseless channel output for m. If there are Tm,djs different codewords for which the 
corresponding noiseless channel outputs are at distance from x^, then we can write ([T]) as: 

AI oo 



m=l dE = l 

= f; T{d,)Q(^) (2) 

where T{dE) is the average number of codewords at Euclidean distance dE from a given 
codeword, with the distance measured at the channel output. The associated BER can be shown 
to be _ 
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Fig. 1. Block diagrams: (i) TE, (ii) precoded TE, (iii) TE-EPCC. 
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where K is the number of information bits per codeword sequence and w^cIe) is the average 
Hamming distance from a given information word to competing information words located 
at dE away, with the Euclidean distance measure based on noiseless channel outputs of the 
corresponding codewords. We next show how T^cLe) is related to the outer code Hamming 
weight enumerator A°{d) and the error event characteristics of the channel. 

A. Error Event Analysis of the 1 — aD Channel 

A trellis section of the 1 — aD channel with no precoding is shown in Fig. [2l The branch 
label Ci/xi signifies the coded input bit to the channel, and the corresponding channel output, 
respectively. Following the same notation as in [11], any error word f with Hamming weight 
d = d^(i) can be uniquely decomposed into a concatenation of disjoint error patterns fj, j = 
1, . . . , m, where the index j signifies the order of occurrence of the error pattern of Hamming 
weight d^ in the codeword. Error patterns fj, j < m, correspond to simple closed error events 
on the trellis that diverge from and remerge into the correct path without sharing any of the 
states in between. However, two scenarios can occur when j = m: either remerges with the 
correct path (closed f^) or the boundary of the codeword is reached while the two paths are 
still diverged (open f^). 

In the 1 — aD channel trellis, diverging branches result in a Euclidean distance separation 
of 1 each, while remerging branches result in a squared Euclidean distance separation of a^ 
each. Moreover, crossing branches accumulate a squared distance separation of (1 + a)^, while 
parallel branches accumulate a separation of (1 — a)^. This means that parallel branches result in 
a lower Euclidean distance separation compared to crossing branches in the Euclidean distance 
distribution when < a < 1. 

Hence, two error pattern classes are distinguishable according to their accumulate Euclidean 
distance. The first class, shown in Fig. [2b, has a squared distance d\{ij) = 1 + iia^ + {dj — 1) x 
(1 — where d^ is the Hamming weight of the error event fj, and yu=0 or 1 depending on the 
event being open or closed, respectively. This class of error patterns is denoted by t^^^^™ and is 
called "the dominant error class", for which all branches, other than the diverging and remerging 
branches, are parallel. The dominant error class accounts for most of the channel bit errors due 
to the low Euclidean distance between the correct and erroneous paths. On the other hand, the 
second class, shown in Fig. lib, has both parallel and crossing branching, and hence its members 
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have Euclidian distance (iKfj) 



Xcr X (1 + + {df -1- Xcr) X (1 - af, where 



Xcr is the number of crossing branches. The second class contributes much less to the overall 
system BER, and thus we call it "the non-dominant error class", which is denoted by By 
the same line of argument, the same two classes are distinguishable for the PRl channel, which 
is a special case of 1 + aD at a = 1. The only difference is that error events with all crossing 
branches now generate the class ;^<^°"*. 



0/0 



4=1 

=1 




J^=l 



4=1 




dff =1 


y 

4 = (i 




^H=l 



(c) 



4 =o(^ 



4 = (x 
4 =0 



Fig. 2. (a) Trellis section for a non-precoded generalized two-tap ISI channel(l — aD), (b) dominant error patterns, (c) 
non-dominant error patterns. 



We design an error-pattern correcting code (EPCC) capable of correcting error codewords f 
that are decomposable into disjoint error patterns ij that all belong to the dominant error class, 
i.e. £j e x''""^, Vj. In order to evaluate the BER performance of EPCC we need to find the 
new Euclidean distance distribution modified by EPCC. However, it would be easier to first find 
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Fig. 3. (a) Trellis section for a precoded generalized two-tap ISI channel (1 — aD), (b) weight characterization of an 
error pattern 



the Euclidean distance distribution before EPCC correction is turned on. We assume throughout 
that code bit values are i.i.d and equiprobable, which is a valid assumption for high rate codes. 
Suppose an error word f, of Hamming weight d^{f) — d, is composed of moom error patterns 

fj G ^dorn^ fhdom = fn — nid^n error patterns G A dominant error pattern of length 
Ij = dniij) will have probability (|)'^ ^ . On the other hand, a non-dominant error pattern fj 



of length Ij and Acr crossing branches will have a probability of ('j^^^^) (|)' 
probability distribution of d\{i) is given by: 



Therefore, the 



Pr(dE|d, m) 



d-m\ n\d-m 



/d-m\ /1\ 
V Acr / V 2 / 



1 \ d-rudo 



(i) 



0, 



Acr > integer, 

rridam < m. 

Acr = 0, 

rridom = rn. 
otherwise. 



\.rr 



d|; — (1 — a^d — 2am + 



(4) 



which is the conditional probability of an error word of Euclidean distance d%, given that its 
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Hamming weight is d, and has m multiple error pattern occurrences, of which nidom belong to 

^dom 

A. 

If we examine the precoded 1 — aD trellis in Fig. |3l we note that a nonzero Hamming 
error results in the diverging of a single error event that remerges only on the occurrence of 
another Hamming error, while all the in between error branches have zero Hamming weights, 
wether crossing or parallel. We also note that an even d^ compound Hamming error decomposes 
into ^ closed single errors, while an odd d^ compound error decomposes into [^J closed 
errors and a boundary error. Moreover, diverging and remerging branches have d\ = 1 and 
d\ = o?, respectively, while parallel and crossing branches have = (1 — a)^ and d?^ = 
(1 + a)^, respectively. This means that, by invoking the random uniform interleaver assumption, 
the probability of a single long error event of d^ = {1,2} producing a low Euclidean weight 
error declines rapidly as the interleaver length is increased, since the probability of an all parallel 
error event declines accordingly. The Euclidean distance of a multiple error event of Hamming 
weight d, Xcr crossing branches, and total length L is: 

4 = r^l + L^J«' + (1 + «)'Ac. + (1 - af{L -d- Ae.) 



Therefor 



Fr:{dE\d,L) 




^ , Xcr > integer, 
otherwise. 

dl-\l]-[l\a'-{l-anL-d) 



(5) 



B. Error Euclidean Distance Distribution of TE-EPCC 

We now develop a method to construct the error Euclidean distance distribution of TE-EPCC, 
for which the comparable distance distribution of TE is a special case where EPCC is turned off. 
Consider a serial concatenation of an EPCC and an interleaved recursive systematic convolutional 
code (RSCC) of length A^. There are Lc EPCC subcodes in each interleave, each of length 
Nc = j^, where an EPCC can correct up to nic multiple occurrences per subcode provided that 
they all belong to the target set of correctable errors. The target set is {fj : ij G x'^"™; d^i^j) < 
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error patterns 
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boundary 
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Fig. 4. Sketch of the method to derive T{dE) 



dc\, where dc is the maximum length correctable error from x'^"'"- An error in the RSCC 
codeword of hamming weight d is mapped by the uniform interleaver into all possible (^) 
interleaved error words f with equal probability. The interleaved error word divides into EPCC 
subcodes, each receiving error word f^*\ i = l,...,Lc, of Hamming weights di, d2, d^^. 
Each EPCC error word f of Hamming weight di decomposes into disjoint error pattern 
occurrences. In the previous section, we found the conditional probability P(dE\d,m) given 
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the error Hamming weight and number of multiple errors m for a single subcode interleave. 
To derive the Euclidean distance distribution for a codeword that is divisible into Lc subcodes, 
we are also required to evaluate the conditional probability of the decompositions rui given the 
EPCC subcode hamming weights d^. The conditional Euclidean distance probability distribution 
can be expanded as follows: 

Fr-{dE\d) = Fr-{dE\d, di, ...,dLj y<Fr{di, ...,dLjd) 
= Pr{dE\d, di, di^m, mi, m^J 
xPr(m,mi, ...,mL,\di, ...,dL,,d) 

xFr{di,...,dLjd). (6) 
Since errors in the Lc EPCC subcodes are disjoint, © becomes: 

d d 

PT{dE\d) = ^ ... ^ Pr(c/i,...,rfLjrf) 

di=0 dLc=0 
d di di^^ 

mi - I] Pr(rfijM,m) JJPr(m,|rf,) 

m=lm\=0 171^^=0 1=1 

(7) 

The joint conditional probability Fr{di, ...jdijd) in dV]) is the probability of dividing the (^) 
possible instants of the interleaved error word f, of Hamming weight d, into the error word 
sequence f with associated Hamming weight sequence di, and is given by 

Mdu...,d,jd) = ^'^^ — (8) 

\d) 

Given that there are di errors in EPCC subcode i, there exists (^'~\) ways by which the Hamming 
weight di error is decomposed into multiple error pattern occurrences, each of length at least 
1. Of these rrii occurrences, fml can be either open or closed. An open error event in this 
context lies on the boundary of the EPCC subcode's data and parity fields. A boundary error 
event is defined this way since we do not count error patterns in the EPCC codeword's parity 
towards the total BER, where this field is discarded before passing the decoded data to the outer 
interleaved RSCC decoder. By examining the trellis we note that boundary errors contribute a 
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squared Euclidean distance separation that is o? less than identical length closed errors that are 
totally encapsulated by the current subcode i data field. Furthermore, there are only 
ways by which the disjoint mi error patterns of error word f can be arranged in the current 
subcode z, given the subcode has a boundary error. Two disjoint error occurrences in the trellis 
are separated at least by the error free distance of the channel, which equals 1 for 1 =1= (xD ISI 
channels. The number of possible arrangements of vrii errors is computed given the fact that the 
last error pattern occurs at the boundary. Assuming errors can occur on and off the boundary, the 
total number of possible error pattern arrangements becomes (^''^'^^) • Given that the EPCC 
parity field is long enough, boundary errors have very low probability of spanning the data fields 
of adjacent EPCC subcodes, and hence, such events are independent among different subcodes. 

So, given Uj, there are [^"'J-A ways by which the mj error patterns, composing f'^*^ can be 
arranged in a subcode i, and since there are (^'') possible error words f*^*^ we get 

\mi—^iJ Vrrti — 1/ 

A pictorial depiction of the derivation method explained above is shown in Figure HI Substituting 
©, dll), and dHl) into dV]), we get an expression for the distribution of error Euclidean distances 
while EPCC is turned off as: 

d Lc 

Vv{dE\d) = 

m=l fi=l 

d = Ef=i du m = ^f^i rui, /i = Y.f=i f^i 
m, a, fi,a : — ^ — ^ — = mod 4 

Lc d di 1 / 1 

1 TT- \ - X - / d — m 



PrK|/x„ d.) = ^m.-,.J^ ym.-v _ 



(^Af j n X] 



d%.—2am+^a'^ — {l—a)'^d 



i=l di=0 m.i=Q Hi=Q ^ 4a 

iV'"^ fN^-di\ f di~l 



TTii — Hi/ \m 



(10) 



where we define (g) = 1. In addition, the Euclidean distance distribution can be decomposed 
into two components: a component Fr:{dE\d,C) associated with error words that are correctable 
by the Lc EPCC subcodes, and the complimentary component Fr:{dE\d,C) associated with non- 
correctable error words. In this case, the Euclidean distance probability distribution of non- 



March 31, 2010 



DRAFT 



16 



correctable error words escaping TE-EPCC is given by 

Fr{dE\d,C) = Pr{dE\d)-Fr{dE\d,C) (11) 
while the correctable component is given by: 

d Lc 

Vr{dE\d,C) = 



m=l fj,=l 

m, d, fi,a : d\ = 2am — fia'^ + (1 ~ a)'^d 

Lc min{d,dc) min(di ,mc) 1 



fN\ 

di=0 mi=0 lJ,i=0 

iV'"" /Nr-d,\ fd, - 1 



\d) i=l 

2/ \mi - HiJ \mi - 1 



(12) 



where for the sake of simplicity, we assumed that an EPCC subcode i could correct an error 
word f*^*) if (i/^(f'^*)) < dc, which is actually a worst case scenario that occurs only if = 1. 
Although this assumption would result in a slightly pessimistic prediction of the EPCC correction 
power, it allows us to avoid a substantially more complicated derivation. To obtain the bound 
on the bit error probability, we need to express the error Euclidean distance enumerators as a 
function of the error Euclidean distance probability distribution given by (fTTI) . We note that the 
average Euclidean weight enumerator associated with the uncorrectable set of error words C is 
given by: 

N 

T{dE,C)= J2 ^"{d)Pr{dE\d,C) (13) 

d — dmin 

while the average information input hamming distance to codewords at squared Euclidean 
distance d\ given by: 

^ 1 ^ 

w{dE,C) = = ^ A\d)X{d)Vx{dE\d,C) (14) 

T{dE,C) 

where K°{d) represents the number of RSCC codeword sequences of weight d, and A*((i) 
represents the average input Hamming weight of RSCC codewords of weight d, and are related 
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where A*'°((i, i) is the number of codeword sequences of weight d that originated from weight 
i information sequences. Details on how to find these marginal error weight enumerators can be 
found in [22] for different puncturing rates and encoder connection polynomials. By substituting 
T{dE,C), given by (fT3l) . and w{dE,C), given by (fT4l) . in ([3]), we get an upper bound on the 
average BER of TE-EPCC as function of Fr:{dE\d,C): 

n< f; f2 ^^i^^i^M^^^g ("^y (16) 

In Appendix A we show how these bounds simplify for the simple case when Lc = 1, i.e. 
employing one EPCC subcode per interleave. Also, we extend the BER bound derived in [11] for 
the precoded dicode channel to the generalized case 1 — aD. Finally, by using an exponential- 
type approximation of the Q function, we show in appendix A that the BER bounds of the 
TE-EPCC, the non-precoded TE, and the precoded TE can be expressed as single infinite sums, 
with the Hamming weight of the RSCC error as the sum index. 

C. Efficient Computation of the Euclidean Distance Enumerator for > 1 EPCC 

A more compact and efficient method is derived here to evaluate the multiple summations in 
equations ([T2)) and (fTOl) . which are used to compute the BER bound in (fT6l) . We first define a 
probability enumerator for subcode i for all possible values of the parameters c/j, rrij and /ij, 
which is given by the multinomial 



A(D, M, X, ^max^ dynax 

-EE E 

^li=Q di=l mi=l 

N,-d,\ fdi-l 
rrii - Hi) \mi - 1 



\2, 

(17) 



where the D°M°T° = 1 monomial term corresponds to the case when there are no errors in the 
specified subcode, and /ij = {0, 1} is the number of boundary errors per subcode. As a result, 
the probability enumerator for the entire interleave composed of Lc EPCC subcodes is given by 

A'^'=(D,M, T; nimaxydmax) 
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given that only rfma^-weight error words f^'^ composed of rrimax disjoint error patterns can 
occur per EPCC subcode, where dmax and rrimax are unbounded from above if EPCC correction 
is turned off. The advantage of this approach is that polynomial multiplication, or the more 
general multinomial multiplication, can be performed efficiently by symbolic manipulators, such 
as Maple™, speeding up the evaluation of (fT2l) and (fTOl) . Utilizing the compact, and easy-to- 
compute, probability enumerator, we can now express the bound on the bit error rate of the 
TE-EPCC as: 



J ^jmin ^ ^ rl—rl W / 1,— n 



K ^ ^ \a ^ f^) 

^ /rf - m\ ^^^^ M, T; oo, oo)],,^,, 

nm — 1 ^ CI / 



m=l 

m: Acr>0,AcrGN 



m=l 
m: Acr=0 



d\ — 2am + jjio^ — {\ — d 
= (lo) 

where the probability enumerator for a correctable EPCC codeword is approximated by 

A^=(D,M,T; m„4), 

for an EPCC of maximum correction power nic per subcode, and N is the set of natural numbers. 



V. INTERLEAVER GAIN EXPONENT OF TE-EPCC 

To gain insight into how EPCC enhances TE performance, we pursue an analytic approach 
to study the mechanism by which EPCC reduces the multiplicity of low Euclidean distance 
errors. For this, we limit our investigation to the dicode channel, for which the spectrum of 
the Euclidean distance is comprised only of integer values of d\, and hence there are a fewer 
values that ds can take in the lower range of the spectrum. The error probability shown in 
([3]) can be lowered by 1) increasing the minimum Euclidean distance between error words, a 
traditional approach, or 2) reducing the multiplicity of low Euclidean distance errors, as in the 
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TABLE n 

INTERLEAVER GAIN EXPONENT OF THE CONVENTIONAL NON-PRECODED TE VS THE TE-EPCC, d| = {1, 2, 3, 4}. 





Error pattern classes 


TE 


TE-EPCC 


TYl — 1 

At = 1 

(1 = 2^ tli 


•r^ — i — • — = — • 

V^^^. io ■■■ 


iV-2 
(1) 


(^) 




lirror pallcrn classes 


TE 


TL-l^PCC 


m = 1 

d = 2 ->■ dT 


— : — • — '■ — • • — T~r* 

-0 ■ ■ ■ 

1 ~- • ' '*1 
1 .' i 


(1) 


/ 155925 \ 
\ 4 J 


d|; = 3 


Error pattern classes 


TE 


TE-EPCC 


,™ 

H = l 

d = 2 ->■ dT 


•^T — i — * — i — * • — Vt* "^t — ^ — • — ! — • 
io ■ ■ ■ y\ io 


(2) 


(779625) 


d| = 4 


Error pattern classes 


TE 


TE-EPCC 


m = 2 
At = 

d = 2 ->■ dT 


* i • i • • * "t j • i • • * * 

Vi^v jo ■■■ y\ jo ■■■ y-\ 


iV° 
(1) 


^ 779625 ^ 



turbo coding paradigm pioneered by Berrou et al. [1]. In turbo coding, the coefficients of the 
error function for low Euclidean distances are an inverse function of the interleaver size, N. 
For this reason, turbo coding gain is often referred to as interleaver gain. At a more detailed 
level, for the frequency of low weight errors to asymptotically approach zero as the interleave 
size tends to infinity, the exponent of the interleaver size in the corresponding error coefficients 
should be less than zero. Therefore, we can argue for the advantage of incorporating an EPCC 
in TE, by showing how it works to decrease the exponent of well below zero, especially 
for low Euclidean distance errors. We call 5 the interleaver gain exponent. First, we isolate the 
exponent of N in the expression of BER for TE and TE-EPCC. The BER expression of the 
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TABLE m 

INTERLEAVER GAIN EXPONENT OF THE CONVENTIONAL NON-PRECODED TE VS THE TE-EPCC, d% = {5, 6}. 



d% = 5 


Error pattern classes 


TE 


TE-EPCC 


m = 3 

a = 6 —t UT 


•^T — f — • • — Vt^ — i — • • — \ — j — • 

^ V ■ ■ ■ ^ ^ , ^ V ■ ■ ■ ^ '^^ 1 ^ v ■ ■ ■ 


jv-i 

(3) 


iV-9 

(3508313) 


d% = 5 


Error pattern classes 


TE 


TE-EPCC 


m = 1 
M = 1 

d = 2^dT 







'4 ■ ■ ■ 


iV-2 
(1) 


Ar-2 
(1) 


d% = 6 


Error pattern classes 


TE 


TE-EPCC 


m = 3 
II — 

d = 3 dr 




(1) 


(1169438) 


•t^ 7 • • \ * •r^ 7 • • * "t^ i • • \ .> 


d| = 6 


Error pattern classes 


TE 


TE-EPCC 


m = 1 
/^ = 

d = 2 dr 


•r^ 

1 ^ 




i ,* • — \ — * 

ft ■■ V'^^l 

i » *' 

y 


(1) 


N-^ 
(1) 



conventional TE (EPCC turned off) for a = 1 is: 



b 



dB=l ^ ^ ci=2 
1 d 

E E 

//=0 m=l 

m: d^—2m+fi=0 mod 4 



* A'' (d)A'((i) 

4 / 



2 y \m — /xy \m — 1 



(19) 



where dx <ti N is the truncated maximum error weight. We truncated the Hamming error weight 
d since large weight errors correspond to larger Euclidean distances which have little contribution 
to the BER. To produce an expression for the upper bound on BER with isolated powers of N, 
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TABLE rV 

INTERLEAVER GAIN EXPONENT OF THE CONVENTIONAL NON-PRECODED TE VS THE TE-EPCC, d% = 7. 



d% = 7 


Error pattern classes 


TE 


TE-EPCC 


m — 4 

rl — A V rim 




(4) 


(4) 

(6237000) 


•^T — f — • • — V~7* — ^ — • • — \ *^ — f — • • — — i — • 


dl = 7 


Error pattern classes 


TE 


TE-EPCC 


m = 2 

d = 3 ->■ dT 


•^z ^ — V 

> 


,* • ^ • 


iV 
(6) 


iV 

(6) 


d% = 7 


Error pattern classes 


TE 


TE-EPCC 


m = 2 
M= 1 

d = 3 — >■ dT 


•e — f — • • — — i — V, 


'4 ■ ■ ■ 


(6) 


(6) 



and at the same time preserve it as an upper bound, we replace the binomial in the denominator 
by the lower bound [10]: 



dj d\ d\' 

Moreover, to replace the binomial in the numerator with an upper bound that is also a power of 
N — d-\-l, we first express it as: 

'N -d\ m-iji+lfN-d+V 



yUi — nj N — d + 1 \m — n + l 
and employ the upper bound [10]: 

N-d+l\ (N - d + ir'"'^^ AT^-z'+i 



jn — fi + 1 J (m — /i + 1)! (m — ^ + 1)! 
These bounds are tight when N is large, and d,m <^ N, which holds true in our case. Also we 
can upper bound the Q function by: 

„ fdE\ . 1 _4 
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TABLE V 



INTERLEAVER GAIN EXPONENT OF THE CONVENTIONAL PRECODED TE VS THE TE-EPCC, d% = {2, 3, 4, 5}. 



dl = 2 


Error pattern classes 


preceded TE 


TE-EPCC 


m = 1 
= 
d" = 2 
L = 2 


*- — i — • — 


• • \ i> 

■■■ y\ 


(2) 


^-10 
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Error pattern classes 
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TE-EPCC 
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M = l 
d^ = 3 
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(779625) 
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4 = 4 


Error pattern classes 
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TE-EPCC 
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= 
d^ = 4 
L = 4 
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iV-2 

(12) 
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4 = 5 


Error pattern classes 


preceded TE 


TE-EPCC 


m = 3 

M = 1 
d« = 5 
L = 5 


•^T — ? • • — ' ■, — \ — • • — — ^ — • 

■ ■ ■ . v m u u ,\ , ■ ■ ■ 


(60) 


(1) 



Substituting these approximate bounds in the BER upper bound in (|T9l) . we get a looser but 
insightful bound: 

dE=l d=2 fi=0 m=l 

m: 4~2m+/i=0 mod 4 

Bd,,d,m,,N^-''-''e-^ (20) 

where Bd^^d,ni,t, is given by: 

— r/' 



d — m \ 

4:^)(^_J (21) 



IX'*'" / d — m\fd — 1 
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For the sake of mathematical tractability, we study the interleaver gain exponent of Lc = 1 
TE-EPCC, i.e. single EPCC subcode per interleave. Utilizing the same approximations as above 
in the BER bound of TE-EPCC for Lc = 1 we get the expression: 



Pb < 



1 °° d2 ^ 



dE=l 



fi=0 



dT d 

^ ] ^ ] ^dE,d,m,fJ, 

d=2 m=l 

m: d^~2m+fi=0 mod 4 



j\^m~fi~d 



min{dj', dc) min(d, rric) 



dE,d,m,ii 



p^m—fj.—d 



d=2 



m=l 
m: d|,=2m— /i 



(22) 

The expression in (|22l) is just the expression in (|20l ) with those terms that are correctable by EPCC 
subtracted. By identifying the maximum exponent of the interleaver length in (|22|) and (|20l) . 
we can compare the asymptotic BER of TE and TE-EPCC in the limit of large interleaver size. 
Assuming the minimum Hamming weight of the outer RSCC code is 2, we list the maximum 
interleaver gain exponent per d'^, for TE and TE-EPCC (d^ = 10, nic = {3,4}, Lc = 1) in 
Table HI] for d| = {1, . . . , 4}, in Table M for rf| = {5, 6}, and in Table |W] for rf| = 7. We 
also list for each d'^, the generating error patterns and their corresponding parameters d, m, and 
/i. In addition, under each interleaver gain exponent, we list in parenthesis the corresponding 
multiplicative coefficient 'BdE,d,m,fi, excluding the term A"{d)A (d) relating to the outer RSCC 
Hamming error weight distribution. 

For the precoded TE, using the same approximations as above, it can be shown that the BER 
bound of Appendix A is dominated by the terms: 



Pb < 



1 

2K 



N 



oo 



4 

2ct2 



(23) 



where is given by: 



B, = A'^{d)T{d)\^]^^ 



(24) 
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In the derivation of the above bound we only kept terms whose error length L is equal to the 
Hamming distance since they have the dominant interleaver gain exponent at each . In 
this case, the dominant error will have d'^ = d^ as shown in Table |Vl 

First, we note that for the non-precoded TE, the interleaver gain exponents are all negative 
for d\ = 1 to d\ = ^, which are the terms that dominate the BER for medium to high SNRs. 
Second, we note that the error patterns, for this same range of error Euclidean distances, up to 
d = 10, all belong to the dominant error class. As a result, the TE-EPCC manages to substantially 
decrease the interleaver gain exponent by a factor of N^. Also, for d"^ = 4, where the TE does 
not achieve any interleaver gain, the TE-EPCC has an impressive interleaver gain exponent of 

The extremely low exponents suggest that the TE-EPCC will have large gain even for relatively 
short interleavers, and would thus deliver satisfactory gain for short to medium RSCC codeword 
sizes. At the same time, for such short interleavers, the TE would considerably suffer in terms of 
turbo gain. These conclusions will be numerically demonstrated in the next section by evaluating 
the BER bound for interleavers as short as 100 bits. Furthermore, although B^^ ^ m.^t is signifi- 
cantly larger in the TE-EPCC compared to the TE for the same d"^, the term B^^ ^ m.^t^™"'' 
is still several orders of magnitude lower for the TE-EPCC. 

Although less important, we also show the interleaver gain for higher error Euclidean distances 
in Table HII] and Table HVl Most notably, the TE-EPCC (dc = 10, = 3, = 1) corrects 
errors belonging to the dominant error class for d\ = h and d\ = 6, lowering, in the process, 
the maximum interleaver gain exponent by a factor of A^, a turbo gain that becomes more 
substantial for large interleavers. Actually, for d"^ = 6, the TE possess no interleave gain, while 
TE-EPCC BER is dominated by the non-targeted set of non-dominant errors that result in the 
exponent A^~^, still achieving an interleaver gain. On the other hand, the TE-EPCC {dc = 10, 
rric = 3, Lc = 1) would offer no advantage when d'^ = 7. Note that although all errors belong to 
^dom y^iiQ^ rn = A, their multiplicity m exceeds the maximum multiple-error-pattem correction 
capability of mc = 3. However, the TE-EPCC {dc = 10, rric = A, Lc = 1) manages to reduce the 
maximum interleaver gain exponent to N^"^, by reducing the contribution of to d"^ = 7 by 
a factor of A^^. 

Comparing the interleaver gain exponents of the TE-EPCC and the precoded TE in Table IVl we 
note that the TE-EPCC focuses on error events of (i| < 4 and d^ < 4, reducing the interleaver 
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exponent by a factor of N^, N^, and iV^ at = {2, 3, 4}, respectively, compared to the precoded 
TE. However, the precoded TE's interleaver exponent is lower by a factor of N compared to 
the TE-EPCC at d| = 5. Hence, we predict that the TE-EPCC's BER floor will be far lower 
than that of the precoded TE, while the precoded TE waterfall BER may still be lower owing 
to the lower interleaver gain exponents of higher Euclidean-distance error events. In summary, 
the EPCC shapes the error weight spectrum to improve the error floor while preserving gains 
achieved in the waterfall region. The TE-EPCC is thus a novel turbo equalization approach that 
enhances the spectrum thinning at low weights, where the error floor is not a strong function of 
interleaver size as the waterfall region is. Actually, all ML type bounds, including our bound, 
study the error floor rather than the waterfall region. This works in our favor since our EPCC 
code's advantage lies there. In addition, our EPCC works in a probabilistic fashion to enhance the 
minimum Euclidean distance, in addition to the interleaver gain, compared to trellis constrained 
methods that directly increase the minimum Euclidean distance. 

VI. A SISO Decoder for EPCC 

We have thus far presented the ideal behavior expected from a perfect EPCC decoder. We now 
discuss a practical implementation of EPCC SISO decoding based on the algebraic single-pattern 
correcting decoder of Section II and the soft side information made available by the channel 
observations r and the outer RSCC SISO decoder. 

In the decoder flow chart, a decision is first made on whether the hard input of the decoder 
c contains a single or a multiple error pattern via the syndrome check. If the initial syndrome 
check indicates either an error free input, or else, a single error pattern with high reliability [15], 
then the following formula is used to generate the soft decision reliability for the k-th hard bit 
in the corrected codeword [23]: 

Afe = 13'''' X Xmax X 4 (25) 

where d is the bipolar representation of the error-free/corrected bit, Xmax is a preset value for the 
maximum reliability at convergence of turbo performance, and the multiplier /S**^*" < 1 is useful 
in incorporating the EPCC SISO decoder in the iterative loop. Note that in an iterative system 
the level of confidence in bit decisions is lower at the initial iterations, and thus multiplying the 
generated log likelihood ratios by the back-off factor reduces the risk of error propagation. 
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On the other hand, if the computed syndrome is unrecognized, signaling a multiple occurrence, 
then the list decoder is activated which involves computing correlator-based reliability estimates 
for local dominant patterns in the ML word, as will be explained later in this section. Simulations 
show that the aforementioned strategy of moving between list-decoding and algebraic single 
pattern decoding results in improved performance compared to running list-decoding all the 
time, since at later turbo iterations single error-pattern occurrences are more likely, and syndrome- 
decoding is more robust in such scenarios. 

In communicating with the other building blocks of the turbo system, the EPCC decoder 
receives the interleaved extrinsic LLR A coming from the outer RSCC code as an a priori input 
in calculating its error pattern a posteriori probabilities. On the other hand, in the final soft output 
stage, after generating a list of the most probable candidate codewords and their likelihoods, the 
decoder uses the list to calculate the output bit-level decision reliabilities that serve as the a 
priori input LLR to the outer RSCC SISO decoder. 
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Fig. 5. The TE-EPCC block diagram. 



The internal workings of the EPCC soft output list decoder considered here consists of four 
stages, see Fig. [51 

• The probability of a dominant single error event is estimated at each likely starting position. 

• The test error word list is generated by inserting the most probable combination of dominant 
error patterns into the channel detector ML output. 

• An array of parallel single-pattern correcting decoders decode the test words to produce a 
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list of valid codewords and accompanying likelihoods. 
• The list of candidate codeword likelihoods is used to generate bit-level decisions along with 
their reliabilities. 

A. Dominant Error Probability Estimation 

At this decoder stage we estimate the likelihood C(e^*^) at all possible locations k that the 
dominant error event e*^*) can occur. A bank of error event correlators can be used for this 
purpose as was shown in [15] and [16]. Let be the channel detector input sequence = 
Ck * hk + Wk, where is the bipolar representation of the transmitted codeword sequence, 
is the channel response of length Ih, and Wk is zero-mean AWGN noise with variance cr^. Also, 
let Qk — Tk — (cfe * hk) — (cfe — Ck) *hk + Wk be the channel detector's output error sequence. If 
a target error pattern sequence e^^^ occurs at positions from k — j to k — j + li — 1, then Qk can 



be written as 



qk = [c- c(')]f '*hk + Wk 



= [e»]f' *hk + Wk (26) 

where is the channel response of the error sequence, and is given by = e^*'' * hk, and 
— li + lh — 2. Using the MAP criterion, we can derive an estimate of the likelihood of e^'^ by 
measuring the distance of the resulting q(e^'^) to the channel observation r relative to the error 
free sequence q(c), which simplifies to just the difference in Euclidean distances of q(e^'^) and 
q(c) measured to r in the ML sense. The ML postulate becomes useful if c is assumed i.i.d, or 
when it is the best that can be done when no a priori side information is available. In practice, 
though, the side information in the form of bit-level log-likelihood ratios can be efficiently 

(i) 

provided by the outer constituent code in the turbo sense. For each , we then estimate [15]: 



'7(4") = E^(9i-(*-«i")0 

k=j 



Xk- aJ (27) 

\^k=j,Ck=+l k=j,Ck=-l J 

where is the a priori LLR of the error-event bit at position k as received from the outer soft 
decoder, and we are assuming here that error event sequences do not include bits, i.e., the ML 
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sequence and error sequence do not agree for the entire duration of the error event. Finally, the 
expanded list of dominant errors and their likely positions is sorted according to the computed 
reliabilities. 

B. Generation of the Test Error Word List 

In order to expand the decoding- sphere radius of the algebraic single-error correcting code, and 
to benefit from channel side information, we adopt a list-decoding structure that resembles Chase 
decoding [24] in the sense of generating test vectors at the parallel decoder input. However, a 
pivotal difference in the methodologies is in the test word construction stage of the EPCC 
decoder, where we flip multi-bit dominant error patterns, rather than individual independent bits 
as in Chase decoding. The resulting list of test vectors may contain one or more words that are 
just one dominant error pattern away from the correct codeword in terms of Hamming distance. 
Hence, if the resulting set of test error words is decoded by an array of single-pattern correcting 
decoders, then, one or more codewords in the list of valid candidate codewords can be the 
correct codeword with high probability. This novel pattern-level extension of the Chase decoding 
algorithm was first proposed in [16] in the context of SISO decoding of EPCC as a building 
block in TE, and in [15] in the context of list decoding of algebraic single-pattern correcting 
EPCC. Recently, a pattern-flipping Chase was also studied in [25]. This later approach differs 
from the earlier work in [15], [16] only in the block that estimates pattern reliabilities, where 
SOVA is utilized to estimate error event probabilities instead of a bank of error-event-matched 
correlators. 

The probability measure of a given test word with a particular combination of dominant error 
patterns is the product of the probabilities of the constituent errors. In the construction of test 
words, we select the most probable errors in the sense of maximizing the correlator function 
of (127]). 

The requirement to have mc-error-pattem-correction capability using the single-pattern correct- 
ing decoders, dictates that test words must include up to mc — 1 single dominant error patterns. 

Starting from the Imax most probable such dominant errors, one can think of Er=T' 

ways 

of corrupting the ML word with up to — 1 local error patterns. From this large set of potential 
combinations, a relatively small subset of most probable combinations needs to be chosen to 
maintain reasonable complexity. One can think of many different ways of effectively constructing 
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such a list [15] based on the probable local error patterns that have been identified. 

C. Parallel Algebraic Decoding 

The list of test error words generated above is delivered to an array of single-error-pattern 
correcting decoders that work in parallel to generate the candidate codeword list. The number 
of parallel decoders is identical to the size of the test word list, and is a crucial parameter that 
controls the EPCC decoder's complexity /performance tradeoff. 

D. Generation of Soft Output 

The candidate codeword list constructed by our "pattern-level" list decoder is used to calculate 
the more familiar bit-level reliabilities that constitute the output soft information supplied by the 
EPCC SISO decoder. We measure the probability of a candidate codeword given the observed 
word by the product of the probabilities of each "local" error pattern forming the candidate 
word. Specifically, let c represent a candidate codeword with, say, K error-pattern corruption 
with respect to the ML word c. Then, the a posteriori probability of this particular test word, 
Pr (c I c,r), is estimated by multiplying the probability estimates of the K local patterns, given 
the channel observation r at the detector input. 

Given the list of codewords and their accompanying a posteriori probabilities, the reliability 
Ajfc of the coded bit Ck is evaluated as: 

Afc = log — p ( N (28) 

where is the set of candidate codewords where = +1, and is the set of candidate 
codewords where Ck = —1. The quantity in (l28l) is utilized when the candidate codewords do 
not all agree on the bit decision for location k. In the event that all codewords do agree on the 
decision for Ck, a method used by [23] is adopted for generating soft information as follows 

Xk = 13''''- X X^a. X dk (29) 

where dk is the bipolar representation of the agreed-upon decision, and Xmax and < 1 have 
the same function as in (l25l). 
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VII. Numerical Analysis and Simulation Results 

Utilizing the analytic approximation of the BER of conventional TE and TE-EPCC systems, 
we study the relative performance of these systems for different levels of the severity of ISI. 
We also study the special case of the dicode channel 1 — D in a variety of channel conditions. 
We will assume throughout the analysis that the SNR rate penalty (in dB) is proportional to 
10 where R is the code rate. 

A. BER-Bound Validation for the Dicode Channel 

The log of the average Euclidean distance distribution of the dicode channel, \ogT{dE), is 
shown in Fig. [6] for conventional TE and TE-EPCC systems. Fig. [6] also includes the Euclidean 
error distribution for the precoded TE, derived in a similar way to that of [11]. \ogT{dE) is 
calculated for a TE with K = 4096, a rate 1/2 base constituent RSCC, punctured to rate R = 8/9 
with generator polynomial connections (31, 33) in octal format, and Lc = 7 EPCC with rric = 3 
and dc = 10. Each EPCC subcode is a (630, 616) systematic cyclic code of rate 0.98 shortened to 
accommodate = 7 subcodes per interleave. From the average Euclidean distance distribution, 
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Fig. 6. logr(d_B) for various TE systems, and (31,33) RSCC. 
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we can conclude that the preceded TE exhibits larger interleaver gains compared to the non- 
precoded TE in the waterfall region, i.e. low to medium SNRs. This is because \ogT(dE) is 
lower for the precoded TE everywhere when d'^ > 3. However, for higher SNRs, at the error 
floor region, the contribution of squared Euclidean distance 2 becomes stronger, and as seen 
in the figure, the average number of Hamming weight 2 errors that generate (i^ = 2 is more 
for the precoded compared to the non-precoded dicode channel. On the other hand, the EPCC 
concentrates on low Euclidean distances, reducing their frequency substantially up to d'^ = 6. 
This results in improved BER in the error floor and yields a similar waterfall BER compared to 
the conventional unprecoded TE. 








SNR (dB) 



Fig. 7. Simulated vs bounded BER for various TE systems using (31, 33) RSCC. 

In Fig. Ul the simulated BER is shown for conventional TEs with precoded and non-precoded 
dicode channels and the TE-EPCC with a non-precoded dicode channel. Moreover, the simulated 
BER is compared with the estimated BER bound computed for the same parameters as in Fig. [6l 
The TE-EPCC is decoded via the practical soft decoder described earlier in Section |Vll where 
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we implement 5 turbo iterations of the non-precoded TE and 10 turbo iterations of precoded 
TE and TE-EPCC systems; we used up to 100 test patterns in the list decoder of the TE-EPCC. 
The number of turbo iterations is chosen for each system such that the turbo gain saturates. The 
figure shows that the TE-EPCC has definite performance advantage in the low error rate region. 
The actual simulation curve comes above the analytical bound for the TE-EPCC at very low 
BERs. This arises from imperfect uniform interleaving in the practical decoders as also pointed 
out in [11]. Nonetheless, the actual gain gaps between the TE-EPCC and the conventional TEs 
seem even large than predicted by the bound; this is mainly attributed to the higher sensitivity 
of conventional TEs to the interleaver design compared to the TE-EPCC, an argument based on 
the interleaver gain exponent of both systems. 




Fig. 8. SNR gain (dB) of the TE-EPCC over the non-precoded TE at a BER of 10"'^ as function of ISI severity level a for 
outer RSCC (7, 5), punctured R = 8/9, and interleaver size A'^ = 616. 
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B. The Severity of ISI 

In Fig. [8] we plot the SNR gain of the TE-EPCC over the non-precoded TE defined as the 
difference in the minimum SNR required to achieve a BER of 10^'' for both systems. The 
BER of the non-precoded TE improves as a — )• 0, since the Euclidean distance of dominant 
Hamming errors grows with their Hamming distance when a < 1, where the error length is 
linearly proportional to (1 — a^) > 0. On the other hand, for a given EPCC correction power 
rric, the BER of the TE-EPCC remains almost the same as a — )■ since dominant Hamming 
errors are correctable irrespective of their Euclidean weight. The net result is a higher SNR gain 
furnished by the TE-EPCC as a — t- 1. Furthermore, for a given a, the SNR gain of the TE-EPCC 
grows as rric is increased, where a 2 dB improvement can be achieved by increasing rric from 1 
to 5 for all the range of a. 
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Fig. 9. Minimum SNR (dB) required to achieve a BER of 10"'' using (7, 5) RSCC, punctured rate 8/9, TE-EPCC {rric = 
3, dc — 10, Lc = 1}, and different interleaver sizes. 
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C. Interleaver Gain 

In Fig. [9] we compare the minimum SNR to achieve a BER of 10~^. The curves of the con- 
ventional TE with the precoded and non-precoded dicode channels and the TE-EPCC for the non- 
precoded dicode channel are shown for interleaver lengths = {50, 100, 200, 400, 600, 800, 1000, 2000} 
bits, punctured rate i? = 8/9 RSCC with connections (7,5) in octal format, and EPCC with 
•nic = {2, 3, 5} and = 10. The SNR gain of the TE-EPCC over the non-precoded TE using 

= 50 is 2.3 dB, 3 dB, and 4 dB for EPCC correction powers rric = {2, 3, 5}, respectively. On 
the other hand, using = 2000, this shrinks to 1.1 dB, 1.3 dB, and 1.8 dB for EPCC correction 
powers rric = {2, 3, 5}, respectively. 

We note that as the interleaver size of the TE-EPCC increases, the turbo gain of TE- 
EPCC increases accordingly. Also, since we maintain the same number of parity bits as the 
codeword length increases, less SNR rate penalty is incurred as A^ increases. On the other hand, 
the probability of m > 1 multiple errors per subcode increases for larger A^, surpassing EPCC's 
correction capability. Due to these conflicting effects of the TE-EPCC, its minimum SNR plateaus 
and even increases as A^ increase beyond a certain point. All in all, the relative advantage of the 
TE-EPCC in practical system seems most visible with small interleaver sizes. Furthermore, as 
can be observed in the figure, increasing rric is also most effective for smaller interleaver sizes. 

In practical EPCC code construction, in order to obtain shorter EPCC code lengths, while 
serially concatenating one EPCC subcode per RSCC interleave, i.e. Lc = I, the EPCC code 
length is shortened from the long (630, 616) EPCC at the same level of redundancy. While to 
support interleaver sizes above 630, we duplicate EPCC subcodes, i.e. Lc > 1, and use shortening 
to fit fractions of EPCC subcodes in one interleave. For instance, we implement (114, 100) EPCC 
of rate 0.88 for interleaver length A^ = 100, and long (630, 616) EPCC -i- shortened (398, 384) 
EPCC for A^ = 1000. 

D. SNR Gain as Function of Lc and rUc 

The performance of TE-EPCC can be further improved by increasing its multiple error 
correction capability mc, per subcode. However, the complexity of the practical decoder would 
increase accordingly as more test words have to be constructed in the list decoder. Fig. [TOl shows 
TE-EPCC's SNR gain over the non-precoded TE for several BER operating points, A^ = 1200, 
punctured R = 8/9 RSCC with connections (7, 5), and Lc = I EPCC with maximum correction 
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Fig. 10. SNR gain of the TE-EPCC over the non-precoded TE at several BER operating points as function of rric for the 
dicode channel, outer RSCC (7, 5), punctured R = 8/9, and interleaver size A'^ = 616. 



the correction capability of TE-EPCC, without considerably increasing its complexity, is to use 
Lc > 1 EPCC subcodes per interleave. To study the design space spanned by nic and Lc for 
a given interleave, we evaluate the BER bound for the set composed of the Cartesian product 
of the sets rric = {1, 2, 3, 4} and Lc = {2, 3, 4, 5, 6}. Then we plot a continuous contour of the 
minimum SNR to achieve BER=10^ by interpolating the values found at the elements of the 
Cartesian product. A contour plot with an SNR step of 0.1 dB is shown in Fig.[lT|for = 1200, 
punctured-rate 8/9 RSCC with connections (7, 5), and EPCC with different combinations of 
and Lc, and dc = 10. We note that the combinations {Lc = 2,mc = 4} and {Lc = 5,mc = 3} 
require a similar minimum SNR=6.6 dB to achieve a floor BER of 10^^. Nonetheless, as can 
be seen in Fig. [TT]the slope the equi-SNR contour lines decreases for higher Lc and lower rUc. 
This means that as the number of subcodes Lc increases per interleave, the correction capability 
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c 

Fig. 11. An interpolated contour plot of the minimum SNR required by TE-EPCC to achieve BER=10~^ for different 
combinations of rric and Lc, N=1200, and RSCC (7, 5) of punctured R = 8/9. 

plateaus, especially when nic < 2. This is due to the higher level of redundancy required 
for shortened EPCC to maintain the maximum correction capability rric of longer EPCC. For 
instance, at one extreme, to maintain the correction capability at a shortened EPCC code length 
of 44 bits, i.e. Lc = 40 and = 1200, a shortened EPCC of rate 0.68 would incur a staggering 
rate penalty of 1.7 dB. An alternative concatenation approach that avoids the rate penalty of 
serial concatenation to a short inner EPCC is discussed in [26]. 

E. Puncturing Rate 

We also wish to study TE-EPCC advantage at various total system rates and distributions 
of redundancy between the outer RSCC and inner EPCC subcode. In Fig. [I2l we compare the 
simulated BER of the conventional non-precoded TE and the TE-EPCC, for interleaver length 

= 4312, different punctured-rate RSCC with connections (7, 5), and EPCC with rric = 3 and 
dc = 10. The results show that the TE-EPCCs composed of either Lc = 7 (630, 616) EPCC or 
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Lc = 22 (210, 199) EPCC concatenated to rate | TE, achieve the same BER in the error floor 
region. Furthermore, they both outperform comparable rate conventional TEs, with Lc = 22 
TE-EPCC furnishing a gain of 1.5 dB with respect to rate | TE at BER=10^^, and = 7 
TE-EPCC delivering similar gain over rate | TE. Moreover, either TE-EPCCs deliver 1 dB SNR 
gain over the precoded TE of punctured-rate |. For a complete investigation of a wide range 
of coding rates, we plot the minimum SNR required to achieve a BER of 10 for punctured 
coding rates from | to ^, comparing the conventional non-precoded and precoded TE to the 
TE-EPCC. Such a comparison is shown in Fig. [13] for interleaver length N = 1200, different 
punctured-rate RSCC with connections (7, 5), and Lc = 1 EPCC with nic = 3 and dc = 10. We 
conclude from the results that the TE-EPCC delivers a uniform gain of 1.5 dB for puncturing 
rates above |. The abnormal peak in BER for puncturing rate | is due to the particular choice 
of puncturing table. The reason why the precoded TE outperforms the TE-EPCC for puncturing 
rates | and | can be explained by examining A°(2) for those puncturing rates, where it was 
shown in [22], using a similar approach to [27], that the outer RSCC does not generate Hamming 
weight 2 errors for these low puncturing rates. Hence, since the BER performance of precoded 
TE is dominated by such errors in the floor region, its BER is significantly improved surpassing 
the TE-EPCC at those rates. In summary, the precoded TE is more effective when the minimum 
Hamming distance of the outer code is larger than 2. Hence, its less effective for high rate 
simple punctured codes, where its hard to design punctured rates of this property. Therefore, the 
TE-EPCC is more effective at high code rates for which simple puncturing is utilized. 

VIII. Conclusion 

In this work, we have studied the BER of the serial concatenation of EPCC and interleaved 
RSCC over ISI channels as an alternative to a single RSCC with and without an inner precoder. To 
facilitate the study of system performance for a wide range of coding rates, interleaver sizes, and 
EPCC design parameters, we have derived an approximate upper bound on the BER of the TE- 
EPCC that is easy to evaluate and that scales well with system parameters. We have also shown 
how EPCC enhances TE performance by reducing the frequency of error words of low Euclidean 
distance, which dominate the BER both in the waterfall and error floor regions. Numerical 
results, calculated via the derived bound, indicate that the TE-EPCC delivers substantial gain for 
short interleaver lengths compared to the precoded and non-precoded TE, which makes it more 
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Fig. 12. Simulation of the TE-EPCC and the conventional TE for various rates. 
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Fig. 13. Minimum SNR required to achieve 10 BER for various TE systems as function of the outer (7, 5) RSCC punctured 
rate, = 1200, and {m^ ^3,Lc = 1, rfc = 10} TE-EPCC. 
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attractive than the conventional TE for hardware implementation. Also, we have demonstrated 
that the TE-EPCC furnishes a uniform gain of 1.5 dB for puncturing rates above 0.75, which 
makes it suitable for high rate applications, such as magnetic and optical recording applications, 
while the precoded TE is a better choice for lower coding rates. 

Appendix 

A. Simple BER bound expressions for Lc = I 

1 ) Non-precoded TE: As discussed above for the 1 — aD channel, the Euclidean distance of 
a compound error event of multiplicity m and 7 crossing branches is given by: 

d\ — 4q;7 + (1 — a^d + 2am — fia^. 

where d is the Hamming distance of the compound error. In order to compare the channel SNR 
of different levels of ISI a, we make use of the noise variance normalization: 

2 1 + ^2 

in which case the dicode channel has the base noise variance cr^. When the EPCC is turned off, 
the expression of the TE's BER reduces to: 



dE\^A°{d)A:{d) 



1 d / , 

y~v I a — m 

//=0 m=l 

m: 7>0,76N 



7 



iV'"" fN -d\ fd-l 



7 



2 J \m — nj \m — 
d\ — 2am + jia^ - (1 - Oifd 



Aa 

(30) 



A good approximation of the Q function that is accurate for a wide range of abscissa is borrowed 
from [28], and is given by: 

^ f dE\ 1 _4 1 _24 
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Hence, in (1301) is composed of two terms as in: 



where 



^ oo 



K 

d=2 

1 d d—m / , 1 \ / T \ /I \ c(~m 

a — 1\ I a — \ 



/i=0 m=l 7=0 



m — 1/ V 7 



(m — /i)! 



Evaluating the summation over 7 by utilizing the binomial identity we obtain: 

1 ^ K\d)K{d) 



d=2 

1 



AT-'^e ^ (l + e 

^4=0 



E 



2a \ ra 

d\ d-\\ 2Ne~^- 



After some algebraic manipulation, (|32l ) simplifies to: 

^ 1 ^ A\d)T{d) 



4a 



iFi (^l-d]2- fi] -A^sech 
where iFi is the confluent hypergeometric function of the first kind [29], [30]. 



(31) 



(32) 



(33) 
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2) TE-EPCC: The BER of TE-EPCC, p^'^'^^^ is expressed as the residual error rate after 
subtracting the error rate component that is correctable by EPCC, , from the conventional 
non-precoded TE BER, P?,, as expressed in: 



Similar to (|3Tl) . using the Q function approximation we have 



with 



^^(^) ^ ^2NY 

d=2 ^ ' fM=0 



min(d,mc) ,, / r i 

dl I d — I 



which can be expanded into two sum terms depending on the value of d: 
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(34) 
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After some algebraic manipulation and gathering of geometric series terms we obtain the sim- 
plified expression: 



(i=2 ^ ' Ai=0 



-/^e ^ 



2a 



2A^(rf!)e~^iFi (^1 - rf; 2 - /i; -2A^e" 



i2NY 

d=mc+l ^ ' M=0 
d\ 



?! /rf - 1\ 
1 - V J 



mc + 1 - 



{2Ne 



2a , I -I 



I 1, TTic + 1 — (i; mc + 1, mc + 2 — /i; —2Ne ~^ 



(36) 



where 2-^2 is the generalized hypergeometric function [31]. 

3) precoded TE: By examining the precoded trellis in Fig. [3l the squared Euclidean distance 
of a compound error of Hamming distance d and length L for the precoded channel ^j^§- is: 

4=r^l + L^J«' + 4a7 + (l-«f(^-rf)- 

Substituting this expression in the bound on BER of the precoded TE derived in [11], and 
utilizing the approximation of the Q function once again, we obtain: 

p 1 ^ A\d)K {d) 



d=2 \d/ 



E 



(l-a)2(L-d)+rfl+L|ja^ ^ [L — d\ _ 4^7 

e "5^. 



E 

7=0 



7 



(37) 
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Evaluating the summation over 7 by utilizing the binomial identity, we obtain after some 
simplification: 



1 ^ 



d=2 \d/ 



ij-g 

^(q;, a) — e cosh 



2« 
5^ 



(38) 



This can be simplified to a single sum over d by the utility of the generalized hypergeometric 
representation, which is given by: 

1 ^ A%d)T{d) (N - _ri]+^ 



e 



3F2 1 1, L^J , d - TV; r^l - A^, 1; ^) ) . 



(39) 



When N ^ d, we can use similar approximations to the ones used in the derivation of the 
interleaver gain exponent, by which one reaches a looser, albeit simpler, bound: 



^ " rdT.id, 2 



m < l^A"'(d)A'(d)-^-A'-rile-^ 

d=2 L2J- 

3F2 (1, L^J ,d-N;\^]-N,l; ^) ) . 



(40) 
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